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ABSTRACT 

A summer program aimed at mastery of instructional 
objectives in reading and mathematics was provided for 110 deaf 
children (5-14 years old), many of whom were from non-English 
speaking or bilingual homes^ Participants were administered, as a 
pretest, selected criterion-referenced tests from the Santa Clara 
Inventory of Developmental Tasks (Reading) and the BASE (Math) 
Systems to ascertain individual instructional objectives for each 
students Findings showed that learning was nearly universal, with 
many profoundly handicapped children mastering an impressive number 
of instructional objectives; that the summer program was not a 
reiteration of previously mastered curriculum; and that there were no 
major departures from the program design^ (Provided are tables with 
statistical data and sample information forms*) (SBH) 
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SUMMKR PROCR.V^l FOR DKAF CHILDRKN 

Chap L e r I. , ?R0( ; RAM ' Oj-^ST R I P*I 1 0\ 

The program is clusi^;ned to provide for ihe educniion of 110 doaf 
chiJdron i:\nnv who cmi Cored school 1;'. to. The pari icipants in this program 
are prc> ^'oi.nd 1 y deaf fr:)in ages 5 lo lA, A major portion of these children 
come from non-Ivai.;l ish speaking or bilinj;ual homes and need additional 
assistance in communication skills development. Participants are regarded 
as educationally dis;*idvautaged in view of their late entrarice to school, 

Th'' su:.mier program operated for 2 8 days, four hours each day at the 
SchoL'l for tPje Deaf, JHS-47M, A teaeher-in-charg,e , assisted by a general 
ass is t an L or^vani/^ed the program, planned orientation sessions and sujH.^ r vised 
all aspects of die program, employing a sl: ff of 18, teachers, three school 
aides, three educational assistants and one school secretary. Classes were 
organized to provide: development of communication skills; learning English 
as a second language; lip reading; basic language arts; health and physical 
education development, cultural enrichment; arts and crafts activities rela- 
ting to reading and mathematics skills development. 

Chapter II, KVALUATI VE IM^OCED URKS 

Gei 1 e I J 1 1 P t"_9i;_rn m Ohj ec t ive : To help pupils achieve mastei^y of instruc- 
tional objectives in reading and mathematics which they fail prior to 
inr. traction as m.easureci by the Santa Clara Inventory of Developmental Tasks 
(Reading) and the BASK (Mathematics) criterj.on referenced tests, 

ICvai ujU_i{>n O^^Jj-<^:J: i^c;_//^ To determine if, as a result of ])ar t icipation 
in the prog.rnm, 70 percent of the pupils master at least one instructional 
objcictive wliicii pric^r to the j^rogram they did not n;:^.ster. 
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Subject s : All participants in the program. 

M c 1 1 d s and P r o c c c i u r e s : Pupils wo re assigned to classes on the 
basis of school records and teacher judgment. The Santa Clara was 
used as a leveler to determine instructional level, in the absence 
of standardized test data. Repeated failure on an item indicated a 
child's level. All participants were administered, as a pretest, 
selected cr iterion-referenced tests from the Santa Clara Inventory 
of Developmental Tasks (Reading) and the BASE (Math) Systems to ascer- 
tain individual instructional objectives for each pupil. For each 
inst ruct ional object ive diagnosed as requiring remediat ion (as 
decermined by pretest failure) , a post- test was administered on an 
individual basis after an appropriate interval of instruction. For 
each in^-: t rue t ional objective, results of passing and failing on both 
the pretest and the post-test should be recorded on the Class Eva].ua- 
tion Rerord (C.E.R.). '^J 

Time Schec hil e ;'' The pretest was administered at th- ocg inning 
of the program; the post-tast at appropriate intervals throughout the 
life ot the program. 

D a t a An a 1 y s i s : Data were analyzed and presented in tabular form 
ascertaining the percentage of participants demonstrating mastery or 
non-mastery of each instructional objective (according to SED classi- 
fication system) at initial testing, and final testing. 



'^1 The terms pretest and post- test when used in the context of an evaluation 
based upon a »• r Lt c i" i.^n - ft.Mv.Mi cod in:; t runirn t are ,i nt nrciiani;eah le vi th the 
terms entry test and mastery test. 



V) 



-3- 



B/E //09-6.1605 



Evaluation Obji.'ct ivc i ^2: To dutermino, as a i-csult of participanion 
in thv \^;ram, ihc. oxtenf to which pupils^. domonst:rate niastoi-y of instruc- 
tional 'jectivus. 

Subjec ts : Same as above. 



and tabu^'ir form to a?^certain each of the following. Tables are appended. 

A. The distribution of pupils failing to demonstrate mastery 
prior to instruction and not receiving sufficient instruction to 
receive the post-test. 

B. The distribution of pupils demonstrating mastery of objectives 
prior to instruction. 

C. The distribution of pupil mastery as a result of instruction 
by inr^tructional objectives. 

D. The distribution of the number of objectives mastered as a 
result of ins true t ion . 

The distribution of percentage of pupils achieving various 
levels of mastery of instructional objectives. 

Evaluation Objective r/3: To determine the extent to which tlie program, as 
actually carried out, coincided with the program as described in the Project 



Methotis and Procedu res : Same as above , 



Time Schedule ; Same as above . 




Data A n>jrrtt4-g.j^ Data were analyzed and presented in narrative 



Proposal , 



/ 
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Delia Loss / 

The analysis gxcIucIop two pupils who attended only one half-^day session, 
i-or the tally of children on Santa Clara developmental tasks, sec the next 
paragraph. 

Methodological Lim i tat ions 

Developmental tasks under the Santa Clara are not readily mapped into 
the State-designated classification of reading and math activities. In some 
instances the Santa Clara developmental tasks (e.g., the ability to creep, 
walk, run) resenhle no reading or math category intlie State schema, and hence 
data on these tasks have been sho\^m separately. In many instances, mapping 
was possible. Accordingly, the Santa Clara results are presented under the 
appropriate reading or math category. / 

For 80 children, all Santa Clara tasks have been completely remapped. 
The total for Santa Clara developmental tasks is reduced accordingly to A2. 

Chapter III. FI. IDINGS 

Ob-j ect i ve / 'I : Did 70 percent of the pupils master at least one instruc- 
tional objective dur.i-.ig the program? Table '*D" (appended) presents evidence 
in the affirmative. Fully 98% and 99% of the student body mastered one or 
more instructional objective during tliG program's course in reading and math 
respectively. Indeed the average child mastered approximately ei ght objectives 
in each area. In addition 34% of the student body (42 pupils) mastered one 
or more developmental tasks relevant to academic achievement during the program, 
at an average rate of three tasks per child. In short, learning was nearly 
universal, with many profoundly handicapped children mastering an impressive 
number of instructional objectives. 

These results are not surprising. Observation shows the staff undertook 
instruction from the very beginning and continued in earnest throughout the 
program's duration. Also from observation, it can be reported that the program 

administration encouraged teachers to give children a sense of accomplishment by 

passing post-tests. / S 

/ i ■ 
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Obj ectiv e a 2: To what extent did pupils demonstrate mastery of in.st 'mc- 
tlonal objo^:tives as a result of participation in the pro^^rain? Addressing 
tliis question with evidence beyond that already presented, we need to consider 
several issues: 

(a) to what extent did a demonstrated lack of n^istery continue unchanged 
throu^;hout the program? 

(b) to wiiat extent did the pro^;ram dwell on familiar territory on which 
pupils had already gained niastery? 

(c) to wliat extent were the gains in learning patterned by subject matter? 
and (d) to what extent were pupils likely to succeed in mastering the objec- 

t ives they undertook? 

Evidence on these issues follows. 

(a) The extent of unattaincd objectives. Only 4% of the student body 
failed a reading item at the pretest and subsequently did not master the 
instructional objectrivc by program's end. Similarly, in math, fully 97% of 
the pupils failing a pretest item subsequentJ.y mastered the instructional 
objective. Virtually all of the Santa Clara developmental tasks reported 
separately from the reading and math which were initially failed were later 
passed. Table "A" presents the details. 

Several factors account for this widespread achievement. Teaclicrs were 
encouraged to set instructional objectives realistically, in light of the 
children's capabilities and the summer's time constraints. Moreover special 
efforts were made by this b.ard-wo rk ing dedicated staff to liave each clilld 
accomplish iiis/her obj ect ive (s) . 
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(b) The extent of fresh instructional objectives. Tc-ible "ii" shows 
how oft :i pupils dcmonstratod mastery prior to the program, expressed as a 
perccp. ' of all pretest attempts. In both reading and math, nearly all 
sfideni:-. in the program failed at least three out of every four instructional 
objectives attempted. In reading, for example, 96% of the student body 
demonstrated mastery of instructional objectives prior to instruction ^5% of 
the time or less. The comparable statistic for math is 97%. Only in the 
develc«npiental tasks was there a higher rate of initial success; 73% of the 
student.Ls in the program successfully completed better than three out of four 
tasks prior to instruction. 

The significantly better showing on the Santa Clara developmental tasks 
is due to classification of the morp difficult developmental casks under the 
appropriate reading or math activities, using the State-approved classification 
schema. This operation left the comparatively easier tasks (e.g., ability to 
run or hop) in the category of developmental tasks. As Table "B" shows, even 
these proved difficult for a number of pupils in this profoundly handicapped 
population. 

In short, the summer * s program was not a reiteration of previously mastere« 
currictluin, 

(c) Variability in learning by subject matter. Table "C" reinforces 
the interpretation placed on Table "A", viz_. nearly universal achievement 
On one instructional objective after another, all or nearly all youth who. 
attempted the objective ultimately attained it. The most difficult objective, 
classification, foiled only 11% of the pupils attempting it. 

(d) The likelihood of scholastic success. Table "K" shows the number 
of instrtictiona] objcctivos each child ::i;ii*.terc 1 as a percenta^.i^ of nil he 
(or she) undertook during the summer program. In both reading and math, a 
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very lii^;h iroportioa of the population (94% and 97% respectively) jittained 
mastery 90~]00% of the time. By contrast, only one program enrollee failed 
to ma a sinr,le math or reading, objective. Yet that same yoanp.strr did 

atteini^i and master four developmental tai.KS. In fact, as Tahle s>iows, 
pupils in the pro\;ram invariably ac(^omp,lished the developmential tasks which 
had been set out for thein. In short, the pro^;ram spav;ned achievcmienu , not 
pointless frustration, an interpretation corrahorated by classroom observa- 
tion. 

The materials and facilities used by nhe program were adequate. The 
pupils and staff persisted admirably in the fr.ce of building renovation, 
which caused noise and grir as well as dislocated the progi'am^s adminis- 
trat vt.' p-_rsonnel. 

*^rt J -.e basis of the evidence supplied above and on-the~scene observa- 
tions, the program is servicing the needs of the specific target population 
for which it was designed. This is a crucial consideration in deciding 
whether to continue the program, since many parties — the children's families 
included — are limited in their ability to meet the special needs of this 
popula t iop^ . 

Prio r lU^co mme n c 1 a t j_o n s 

In evaluating the 1974 Summer Program, Dr. Morrill T. hollinshead had 
recommended increasing staff for classes of deaf pupils with intellectual 
limitations. Implementdng the suggc\stion, a class v;ns established for 
retarded (CIvMD) youngsters, sta;fed by a specialist in that field. 

Objective : To what extent did the actual program coincide with the 
proposa"! des.ign? There were no major cieiKir turi-' frorl^the program desi^\n. 
Several minor variations should be mentioned, however. Also difficulLies 
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encountered in the implementation of the dcsiju^ qre reported below. — 

The pro^;rani c'esi^^n required the use of the results of a May, 1975 
TitJe I city-wide test as a "leveler", i.e., as a basi55 for i;roupin^; 
children into instructional groups. Cliildren at the School for tlie Deaf 
were not .'idnilnistered such a test. Hence classroom assignments were based 
on school recorcis, teacher judp,m.ent, and the children's perfonnanco on the 
Santa Clara Inventory of Developmental Tasks. Repeated failure on a test 
item established a child's instructional level. This test usage registered 
substantial pupil "mastery" on developmental tasks initially. The frequency 
with which mastery was observed (Table B) reflects this use of the Santa 
Clara rather thar. a tendency on the part of the staff to reiterate curriculum. 

The design structured partially incompatible requirenients . The results 
of the Santa Clara are not lilways readily transcribed into the State-approved 
classification of reading and math activities. During the summer, teachers 
used two scoring schemas , recording their activities sometimes in terms of 
the Santa Clara recording schema and at other times in terms of thc^' State- 
approved system. Where possible, activities recorded under the Santa Clara 
system have been reclassified by the evaluator to conform to the State 
classification schema. As this was not always possible, a residue of Santa 

Clara items hav<^ been reported in tiie tables and MIR Section III, Item 30 

' } ^ ' ^ ' ^^^^^ 

The i+q'iired^ h(\'iding in T/ff^le "A"\ ("Number of Instructional Objectives • 

Failed") was amended by adding "Without Follow-Up". Th- statistic refers not 

to pretest failure alone, but to pretest failure with a post-test follow-up. 



/ 



Finally several minor difficulties in test administration and data 
collection were enco'intered in the shift to a new type of test, i.e., cri- 
terion referenced testing. For one thiin',, the method of recording i)ost- 
te.st results used by the program departed somewhat from the official Class 
Evaluation Record schema, in that no symbol was used to signify post-test 
or post-test failure. Thus an "E" on the program \s records might reflect 
either no post-test or post-test failure. J^ie effect of this recording 
error upon the data is to understate the apparent amount of instruction 
taking place during the summer in Table "A". 

Some confusion resulted from the adoption of a new type of test. 
Teachers struggled witli tiio tendency of criterion-referenced tests to direct 
the path of instruction, as opposed to adopting test-items tliat fit a 
preconceived course of instruction. Maintaining a new recording, system on 
a daily basis tli iighout- the program's duration constituted a si;:ecihlc 
clerical task, especially for teachers w\\o indiviciuate their instructional 
objectives. Finally, the evaluator did not par t icipate in the- initinl orien 
tation to the new tests and their administration. Conseciuentl y lie v;a.-; of 
minimal :issist:anee to teachers and the prograip coord in.-itor when questions 
about the initial guidance arose. 

Many of these difficulties couJd be avoided by a careful review of 
testing materials and rr-c ord iin; devices by the evaiuator and prog,rnm admin is 
trator in pre-program conferences before perju)nne] ti'aining. 

Chapter IV. S UMMARY O F MAJOR Fi:[ni;JCS\_ H )N(:lUS f 0:;s^, A:in_ Id:C(^MM_l,:;i),\TI(,JN'S 
Summarj/ 

The summer prograu) serv(»s a pc^pu i/il. i (Mi v/hich );ener<jlly iin;; few, if nny, 
o])L ion:-; { or de vi.^ 1 opwieiit -ron iuc LV e at L i \ i t i es (hi r i ii;/, Uie r,[\\r,:]]^ ■ i . hi :,t.-.'l-J n^', 
to advance this hand i capi)-,'d j)(^j)u I a t ion ' s cognilive deve 1 ()'p!:),-ri f , i!;anv moi-e 



-10- B/E //og-Gieos 

than 707 (Objective //I) attained one ins L rue t iona.L objective. Indeed, the 
averaj'.'. '.^il atlainod nearly cl^;ht insLruclionnl :i t.cm.^^ in reading and math 
each. .: short, learnini; ' widespread (Objective /•2) . 

The program was instituLod as v;riLLcn (Objective //3) wiih but minor 
exception. Ilov/ever the adoption of criterion-rc»f erenccd testing, complicated 
the pro^;rani's implementation and evaluation. 

Con c liKs i on 

The data fvive the clear iiu]u'ession tliat this pror.ram advance.^ tiie cogni- 
tive ^;rcn-;th of hand i c:ippt:-d youne,sters. 

Rc^£) timk ' n d nj _ i £mi_s 

The prof;ram should dL'finitely be continued. This recommendation is 
predicated on the demonstrated progress of students over the summer and on 
the basis of the lack of meaningful summertime options for deaf children. 
The costs of this p 1*0 gram are small compared to the long-run costs that 
would be OAacted by failure to develop dc:af children into cconoini ra. 1 ly pro- 
ductive achilts. 

As for program evaluation, instruments should be selected in conjunction 
vi til thL- development of othcu" prograiii components. Where a new mode of testing 
is adoj)tt'fi, as in the present instance, the evaluator should participate in 
pr(>-[^rogrom ecuif erences and any worksliops on test administration, so as to 
assist prog,iMm coordinat:or and other program personnel ^n the desig^n and 

performance of their t es t-adm In is i ra t i on responsibilities. 
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DJST. ION OF PUPII. NON-MASTKUY ON PRI-TKST AND NO POST-TLST FOLLOW-UP 

Nuinbc 1- ii Instructional Number of Percenta^*e 

Objectives Wi ijj ou i Foil ow- Up Pupils o f Pup i j_s_ 

Reading,: 

3-4 1 1 . 

1-2 4 3 (f 

None 117 96 



Math; 



122 100 



1-2 4 3 

None 118 _97 

122 ~ lOO' 



Developmental Tasks; 
None 



122 100 



TABLE "B" 

DISTRIBUTION OF VUPIL MASTERY OF INSTRUCTIONAL OBJECTIVES PRIOR TO INSTRUCTION 

Percentage of Mastery ot' Number of Percentaj;e 

JiD^ ^-QiLLL9 Jl^^lJJ- 'iLUl^Ji^^ Pupi Is o f IV ip i 1 s 

Read ing : 

76-ioo:>: 0 0 

51- 75% 2 2 

26- 50% 2 2 ' 

0- 25% 118 96 



Math 



122 100 



76-100/', , 0 0 

51- 75% ' 1 ] 

26- 50% 3 2 

0- 25% 118 97 



122 100 

Developmental Tasks : 

76-100% 31 73 

51- 75% 3 8 

26- 50% 8 19 

0- 2 5% jO_ p 

42 Too" 
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DISTRTBITT^" OF PUPIL ASTFRY PY IKSTRLCTTONAL OnjrCTI\7; AS A RFSUI.T OF INSrRlTTION 
Inctructi To JfHctlve Ratio of pv nlls ftchift vir *'_ rrnnt<r ^rv Percontflgre of 
MAth: ^ ~ 



liOl 


377/378 


100 


1102 


17/17 


100 


1103 


7/7 


100 


1107 


83/83 


100 


1103 


27/27 


100 


1109 


39/39 


100 


1110 


k/k 


100 


1205 


57/57 


100 


1301 


30/30 


100 


1305 


28/29 


97 


1306 


22/22 


100 


1601 


179/179 


100 


1602 


i|8/50 


96- 


1603 
Pociing : 


10/10 


100 


2101 


268/268 


100 


2102 




100 


2icyi 


11/11 


100 


, 2105 


6/6 


100 


2110 


16/16 


100 


2203 


5/5 


100 


22 o;^ 


6/6 


100 


2207 


2^1/24 


100 


2301 


33/33 


100 


2305 


35/35 


100 


2U02 


i^2/k7 


89 




60/60 


100 


2k0^ 


'1 2/42 


100 


2^06 


16/16 


100 


2^107 


137/137 


100 


24-oy 


5/5 


100 


2'+09 


103/104 


99 


2iH3 


12/12 


100 


Dovolopmontal Tasks : 






Motor Coordination 


11/11 


, 100 


Visual J'otor 


8/8 


100 


Visual Porcontlon 


14/14 


100 


Vlsiial Konorv 


17/17 


100 


Auditory Porcoption 


25/25 


100 


Airlltory Konory 


16/16 


100 


Lan?^ua,n;o Dovoloprn-'^nt 


26/26 


100 


Conceptual D«vGlopme»nt 


15/15 


100 



iv) 
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7mF. "D" 



DISTRIP,- -J OF Tl- ML'J.fBFR OF IN'STP.ICTIO.N'AL OBJFCriVFS MASTER.^ AFT.^ IK^TRUCTIO> 



Hujmbor . r.3triv:tlonjl 
O b.jncti-. .. .''".stftrr^d 

None 

1-2 

3-^ 

5-6 

7-0 
- 9-10 
11-12 
13-14 
15-16 
17-18 



Math! 



Nona 
1-2 

3-i^ 
5-6 
7-8 
9-10 
li.-12 
13-1-'+ 
15-16 
17-18 
19-20 
21-22 



Utmibar of 
Pupil.-; 



3 

7 
15 
22 
ill 
22 

5 
1 
0 
6 

122 

1 
14 

3 
21 

35 
24 
12 
5 
3 
1 
0 

— 1 

122 



Porcontago of 

Pupils 



2 
6 
12 
18 

y 

il 
1 

0 

100 

1 
6 
3 

l« 
30 

21 
10 

k 

3 
1 

0 

100 



iK'VclcipniL'U t .1 1 Task 



.1-2 
3- A 

7- 8 
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CFFIC" CP EDUCATIC:V>L EVALU ATI O:! • DMA 1X35 FulH 
(jc^ach Lo k5, iccn v30) ' Function iV 09-61605 , ' '"^ 

\ 

In this tabic enter all D^^i^^ L^ss infcrr.ation. Bof,;oen KIR, iter. ^30 and this form, all participants 
in each activity rust be accounted for. T'ac ccuponcnt and activity codes u^d in coinplction of itcn l30 
should be used hctc so that the t-.'o tables r.atch, See cofiaitions bclc.' table for further ■'nstructions. 
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(1) Identify the participants by specific grade level (e.g., grade 3, grade 9), Where ,cral gradeo ere cooblccd, 

enter the last f«'0 digits of the cop.ponent code, 

(2) Identify the test used and year of publication O'i'^T-yO, SHW-I^, etc.). 

(3) NuT.ber of participants in the activity. 

(4) Jluu.bcr of participants included in the pre and posttest calculations found on itei^^BO, 

(5) Nu::ber and -i.Tccnt of participants not tested and/cr not analyzed on itcinf/30. 

(6) Specif) all reasons why students were not tested and/or analyzed, For each reason specified, provide a jcpirite 

i •ER?C'"'-^'^°"^^' ^"^''''^'^ docur.cntatlon is available, please attach to this form. If further ipici Is , • 
*^"™"r.ecdcd to lu-'ccify and cx'plain data' loss, attach additional pagea to this forn. ^ 



OFFICE OF mt\Tm\l -VALUATION ■ DATA L03S FCRH . . 

(acuch to m, item -.'/SO) ' Function i f 09-61605 , \ 

In this tabic enter all loss infcmtion. Between MIR, item i)30 and this form, all participant! \ 
In each activity cust be accounted for» The conponent and activity codes used in completion of iten B \^ 
should be used here ao that the two tables natch. Sec definitions belw table for further .instructions. • 



Cocponect 
Code 



Activity 
Code 



(1) 
Group 

I.D. 



(2) 
Test 
Used 



(3) 
Total 
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64 



(4) 
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Tested/ 
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(1) Identify .the participants by specific grade level (e.g.. sradc 3, grade 9). Where several grades are coc^lned, 

enter the last f.-o dli^lts of the cor.ponent code. , . 

(2) Identify the test used ar/J year of publication 0'1'\'."70, Sm-74, etc.). 
ni SuT.bcr of participants in the activity, 

axtcr of artlclpants MM In the pre and posttest calcelat ons o»n o. iterf30. 

(3) -d percent ^^^^l^ — „ specified, provide . ..p.r.t. 
tRIC:,., „ sjeeify end cxpUtn data loss, attach additional pages to this forn. . iv) 



